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We propose and study a system whose dynamics are governed by predictions of its future states. 
General formalism and concrete examples are presented. We find that the dynamical character- 
istics depend on both how to shape predictions as well as how far ahead in time to make them. 
Comparisons of these predictive dynamical models and corresponding delayed dynamical models 
are discussed. 



Predictive behaviors are common in our everyday activities. A few examples include the timing of braking when 
driving a car, catching a ball, trading stock, and shaping population control policies. One of the main principles 
of normal dynamics is that the past and present decide the future. Most physical theories have been founded on 
this principle. It should be noted, however, that the picture of identifying a positron going forward in time with an 
electron "coming back from the future" has brought new insight to elementary particle physics 0. Given the common 
occurrence of making predictions, considering theoretical pictures of systems whose dynamics are explicitly governed 
by predictions or estimations of future states may be constructive. In light of this background and motivation, the 
main theme of this letter is to propse predictive dynamical systems by presenting concrete examples. The behavior 
of such dynamical systems depends on both how the predictions are made and how far in advance they are made. 
We start with the general differential equation form of predictive dynamical systems, given by 

^£>=F{x(t),x(i)). (1) 

Here, x(t) is the dynamical variable, and F(x) is the dynamical function. x{t) is a prediction of x at future time t < t. 
This dynamical equation implies that the rate of change of x(t) depends not only on its current state, but also on the 
l— — '. predicted future state x(t) through dynamical function F. Naturally, when t = t, it reduces to a normal dynamical 
I ' equation. In this letter, we discuss the class of equations of the form 

> ■ 

^l=-ax(t) + f(m (2) 

with a constant a > for comparison with the corresponding delayed dynamical equations Q,S,B>I3- 

There is a variety of ways we can choose i and the prediction x(t). In this letter, we set t — t + rj with a parameter 77, 
which we call "advance." In other words, the dynamics are governed by the predicted state of the dynamical variable 
x at a fixed interval 77 in the future. To predict x, we consider two cases. The first case is to extrapolate the dynamics 



. for the duration of the advance 77 with normal (ry = 0) dynamics, so that 
£ ' _ r*+n 

■ ' x(t = t + j])= F(x(s))ds + x{t). (3) 

""O ' Jt 
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We call this the "extrapolate prediction." The second case is to assume the current rate of change of x continues for 

J-^ ' the duration of the advance. This case is termed the "fixed rate prediction" and is given by 



x(i=t + r))=r)^-+x(t). (4) 

We examine how these different predictions, together with the value of the advance, 77, affect the nature of dynamics. 
We start our investigations by computer simulation. To avoid ambiguity and for simplicity, time-discretized map 
dynamical models, which incorporate the above-mentioned general properties of the predictive dynamical equations, 
are studied for the rest of this letter. The general form of the predictive dynamical map is given as follows. 

x(t + l) = (l-fj,)x(t)+f(x(t + ri)) (5) 

where /1 is a rate constant. The extrapolate prediction can be obtained by iterating the corresponding normal map 
(?/ = 0) for the duration of 77. The fixed rate prediction is obtained by setting x(i =73 + 77) = v( x {t) ~ x (t ~ 1)) + x(t). 
The first model we consider is a "sigmoid" map (Figure 1(a)) with 



2 




FIG. 1: Dynamical functions f(x) with parameters as examples of simulations presented in this letter, (a) Sigmoid function 
with 13 = 0.8. Straight line has slope of a = 0.5. (b) Mackey- Glass function with parameters j3 = 0.8 and n = 10. Straight line 
has slope of a — 0.1. 



This function is often used in the context of neural network modelings 6, 7f ■ We simulate this model with both 
the extrapolate and fixed rate predictions. Some examples are shown in Figure 2. In these examples, we have set 
the parameters y, and to the same values for both prediction schemes. In this parameter set, the origin x = is a 
stable fixed point when there is no advance, jj — 0. In the case of the extrapolate prediction, this property is kept 
even when rj is increased. The situation is quite different for the case of fixed rate predictions. Here, an increasing rj 
breaks the stability of the origin, and periodic behaviors arise. 

The same comparison is made with the second model by setting the dynamical function to the "Mackey-Glass" 
map (Figure 1(b)) given by 

1 + x n 

This function is first proposed in modeling the cell reproduction process and is known to induce chaotic behaviors with 
a large delay[2|. The examples of results from computer simulations are shown in Figure 3. We can see again that 
even though the extrapolate prediction does not change the stability of the fixed point with an increasing advance, 
the fixed rate prediction case gives rise to complex dynamical behaviors. 

Now we would like to discuss a couple of issues based on our results on predictive dynamical models. First, let us 
examine the differences in dynamical behaviors between the extrapolate and the fixed rate predictions. Analytically, 
we can expand Eq. @ around the fixed point to examine its stability. We can obtain the following through linear 
stability analysis: 

(l-0v)^- = (-a + 0)z(t), z = x-x\ /3 = f-| K=x , (8) 
at dx 

where x* is the fixed point. For the case of the fixed rate prediction, we can see that the advance, rj, can switch the 
stability. In the extrapolate prediction, on the other hand, the stability is not affected by the advance, provided that 
the corresponding normal dynamics have a monotonic approach to the stable fixed point. (Details of this stability 
analysis will be discussed elsewhere 0-) Qualitatively, we can argue that the fixed rate predictions tend to "overshoot" 
compared to the extrapolation, leading to destabilization of the fixed point with a larger advance, rj. Higher order 
analysis and other analytical tools to understand these types of equations need to be developed to capture the 
behaviors of dynamics. 

Second, we can compare our results with the case of delayed dynamics. Specifically, we consider the delayed 
dynamical differential equation and the corresponding map given by 

^- = -ax(t) + f(x(t-r)) (9) 
x(t + 1) = (1 - fj,)x(t) + f(x(t - r)). (10) 



These equations describe dynamics whose rate of change is governed by both current and past states with a fixed 
interval of delay r. These equations have been studied with a variety of applications for systems with delayed feedback. 
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FIG. 2: Examples for comparison of fixed rate (left column) and extrapolate (right column) predictions for sigmoid map with 
fj, = 0.5 and /3 = 0.8. Values of advance r\ are given as (a) 0, (b) 2, (c) 5, (d) 20, and (e) 80. 
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FIG. 3: Examples for comparison of fixed rate (left column) and extrapolate (right column) predictions for Mackey-Glass map 
with (i — 0.5, (3 — 0.8, and n = 10. Values of advance t] are given as (a) 0, (b) 2, (c) 8, (d) 10, and (e) 20. 
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There are differences and similarities in the predictive and the delayed dynamical equations (0) and I©- We first note 
that simple replacement of the advance by the delay does not lead to the same characteristics of the dynamics. For 
example, if we simulate both sigmoid and Mackey- Glass maps with the same parameter set as in Figures 2 and 3, and 
include a delay r = rj, the sigmoid case does not show oscillatory behavior. On the other hand, the Mackey- Glass map 
shows qualitatively similarly complex behavior with an increasing delay (Figure 4). In the case of delayed dynamics, 
we need to decide on the initial function and delay. Analogously, in predictive dynamics, the prediction scheme and 
advance need to be specified. Common to delayed and predictive dynamical systems, both factors respectively affect 
the nature of dynamics. 

Finally, in the same way that we have considered random walks with delay (delayed random walks) 0, 1 1 Ol ] , random 
walks with prediction (predictive random walk) can also be considered. Even with a small delay, delayed random 
walks give rather complex analytical expressions for statistical quantities, such as variance. Analogously, the analysis 
of predictive random walks is not straightforward^. Mathematically, one may argue that these predictive dynamical 
and stochastic models can be cast into the framework of normal non-linear dynamical systems as, after all, predictions 
are based on current and past states. Indeed, we can apply linear stability analysis to gain a partial understanding. 
However, in theoretical modeling, particularly for such fields as physiological controls, economical or social behaviors, 
and ecological studies, explicitly taking future predictions into account may be useful, explicitly. For example, a recent 
study of human stick balancing tasks on a fingertip has revealed that corrective motion of the stick is frequently shorter 
than the human response time |llLll2lll3| . This is a task where both the feedback delay and predictions are intricately 
mixed. Models based on delayed dynamics have been proposed, but such models may be further developed by using 
predictive factors to investigate the experimental results. Models for this and other concrete applications have yet to 
be constructed and further analysis of predictive dynamical systems has yet to be explored. 
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FIG. 4: Dynamical behaviors of delayed dynamics for sigmoid (left column) and Mackey-Glass (right column) maps. Values 
of delay are set to r = 77 for comparison with previous Figures 2 and 3. For sigmoid map, they are r = (a) 0, (b) 2, (c) 5, (d) 
20, and (e) 80, and for Mackey-Glass map, r =(a) 0, (b) 2, (c) 8, (d) 10, and (e) 20. (Initial condition during (— r, 0) is set at 
same initial value as x(0) = 0.5 in predictive cases. ) 



